1 Introduction 


Linear Matrix Inequalities (LMIs) and LMI techniques have emerged as 
powerful design tools in areas ranging from control engineering to system 
identification and structural design. Three factors make LMI techniques 
appealing: 


e a variety of design specifications and constraints can be expressed as LMIs 


e once formulated in terms of LMIs, a problem can be solved exactly by 
efficient convex optimization algorithms (the “LMI solvers”) 


e while most problems with multiple constraints or objectives lack analytical 
solutions in terms of matrix equations, they often remain tractable in the 
LMI framework. This makes LMI-based design a valuable alternative to 
classical “analytical” methods. 


See [9] for a good introduction to LMI concepts. 


The LMI Control Toolbox is designed as an easy and progressive gateway to 
the new and fast-growing field of LMIs: 


e for users mainly interested in applying LMI techniques to control design, 
the LMI Control Toolbox features a variety of high-level tools for the 
analysis and design of multivariable feedback loops (see Chapters 2 
through 7) 


e for users who occasionally need to solve LMI problems, the “LMI Editor” 
and the tutorial introduction to LMI concepts and LMI solvers provide for 
quick and easy problem solving 


e for more experienced LMI users, the “LMI Lab” (Chapter 8) offers a rich, 


flexible, and fully programmable environment to develop customized 
LMI-based tools. 


The LMI Control Toolbox implements state-of-the-art interior-point LMI 
solvers. While these solvers are significantly faster than classical convex 
optimization algorithms, it should be kept in mind that the complexity of LMI 
computations remains higher than that of solving, say, a Riccati equation. For 
instance, problems with a thousand design variables typically take over an 
hour on today’s workstations. However, research on LMI optimization is still 
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very active and substantial speed-ups can be expected in the future. Thanks to 
its efficient “structured” representation of LMIs, the LMI Control Toolbox is 
geared to making the most out of such improvements. 


Toolbox Features 


The LMI Control Toolbox serves two purposes: 


e provide state-of-the-art tools for the LMI-based analysis and design of 
robust control systems 


e offer a flexible and user-friendly environment to specify and solve general 
LMI problems (the LMI Lab). 


The control design tools can be used without a priori knowledge about LMIs or 
LMI solvers. These are dedicated tools covering the following applications of 
LMI techniques: 


e specification and manipulation of uncertain dynamical systems (linear-time 
invariant, polytopic, parameter-dependent, etc.) 


¢ robustness analysis. Various measures of robust stability and performance 
are implemented, including quadratic stability, techniques based on 
parameter-dependent Lyapunov functions, 4 analysis, and Popov analysis 


e multi-model/multi-objective state-feedback design 

e synthesis of output-feedback H., controllers via Riccati- and LMI-based 
techniques, including mixed H2/H.. synthesis with regional pole 
placement constraints 

¢ loop-shaping design 


e synthesis of robust gain-scheduled controllers for time-varying 
parameter-dependent systems. 


For users interested in developing their own applications, the LMI Lab 
provides a general-purpose and fully programmable environment to specify 
and solve virtually any LMI problem. Note that the scope of this facility is by 
no means restricted to control-oriented applications. 


LMIs and LMI Problems 


LMIs and LMI Problems 


A linear matrix inequality (LMD) is any constraint of the form 


A(«) z= Ao + ayA1 +--+: +anAn <0 (1.1) 
where 
e c= (#,...,¢n) is a vector of unknown scalars (the decision or optimization 
variables) 
e Ag,...,An are given symmetric matrices 
e “< 0” stands for “negative definite”, i.e., the largest eigenvalue of A(x) is 
negative. 


Note that the constraints A(x) > 0 and A(x) < B(x) are special cases of (1.1) 
since they can be rewritten as — A(x) < 0 and A(x) — B(x) < 0, respectively. 


The LMI (1.1) is a convex constraint on z since A(y) < 0 and A(z) < 0 imply 
that A(44#) < 0. Asa result, 


e its solution set, called the feasible set, is a convex subset of R” 
e finding a solution z to (1.1), if any, is a convex optimization problem. 


Convexity has an important consequence: even though (1.1) has no analytical 
solution in general, it can be solved numerically with guarantees of finding a 
solution when one exists. Note that a system of LMI constraints can be 
regarded as a single LMI since 


Ai(z) <0 
: is equivalent to A(x) := diag(Ai(z),...,Ax(x)) <0 
Ax(x) <0 
where diag(A;(z),..., Ax(«)) denotes the block-diagonal matrix with 
A,(2),...,Ax(«) on its diagonal. Hence multiple LMI constraints can be 


imposed on the vector of decision variables x without destroying convexity. 


In most control applications, LMIs do not naturally arise in the canonical form 
(1.1), but rather in the form 


L(X1,..., Xn) <R(X1,...,Xn) 


where £(-) and R(-) are affine functions of some structured matrix variables 
X1,...,Xpn. A simple example is the Lyapunov inequality 


ATX+XA<0 (1.2) 
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where the unknown X is a symmetric matrix. Defining x,,...,2, as the 
independent scalar entries of X, this LMI could be rewritten in the form (1.1). 
Yet it is more convenient and efficient to describe it in its natural form (1.2), 
which is the approach taken in the LMI Lab. 


The Three Generic LMI Problems 
Finding a solution z to the LMI system 


A(x) <0 (1.3) 


is called the feasibility problem. Minimizing a convex objective under LMI 
constraints is also a convex problem. In particular, the linear objective 
minimization problem 


Minimize c7z subject to A(z) < 0 (1.4) 
plays an important role in LMI-based design. Finally, the generalized 
eigenvalue minimization problem 

A(z) < AB(x) 
Minimize subject to 4 B(x) >0 (1:5) 
C(x) <9 
is quasi-convex and can be solved by similar techniques. It owes its name to 


the fact that . is related to the largest generalized eigenvalue of the pencil 
(A(x), B(@)). 


LMIs in Control 
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Many control problems and design specifications have LMI formulations [9]. 
This is especially true for Lyapunov-based analysis and design, but also for 
optimal LQG control, H,. control, covariance control, etc. Further applications 
of LMIs arise in estimation, identification, optimal design, structural design 
6, 7), matrix scaling problems, and so on. The main strength of LMI 
formulations is the ability to combine various design constraints or objectives 
in a numerically tractable manner. 


A non-exhaustive list of problems addressed by LMI techniques includes: 


e robust stability of systems with LTI uncertainty (y-analysis) [24, 21, 27] 


e robust stability in the face of sector-bounded nonlinearities (Popov 
criterion) [22, 28, 13, 16] 


LMIs in Control 


e quadratic stability of differential inclusions [15, 8] 
e Lyapunov stability of parameter-dependent systems [12] 


¢ input/state/output properties of LTI systems (invariant ellipsoids, decay 
rate, etc.) [9] 


e multi-model/multi-objective state feedback design [4, 17, 3, 9, 10] 
e robust pole placement , 

e optimal LQG control [9] 

e robust H,, control [11, 14] 

e multi-objective H,. synthesis [17, 23, 10, 18] 

e design of robust gain-scheduled controllers [5, 2] 

¢ control of stochastic systems [9] 

e¢ weighted interpolation problems [9]. 


To hint at the principles underlying LMI design, we review the LMI 
formulations of a few typical design objectives: 


Stability: the stability of the dynamical system 
r=Ax 
is equivalent to the feasibility of 
Find P = PT suchthat ATP + PA<0, P>I. 
This can be generalized to linear differential inclusions (LDI) 
z= A(t)e 


where A(t) varies in the convex envelope of a set of LTI models: 


n N 
AO) € Colder) = Joa: A : a; > 0, Yoni. 
i=l i=l 


A sufficient condition for the asymptotic stability of this LDI is the feasibility 
of 


Find P = P? such that APP + PA;<0, P>I. 
RMS gain: the random-mean-squares (RMS) gain of a stable LTI system 


zr=Arxr+Bu 
y=CxtDu 
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is the largest input/output gain over all bounded inputs u(t). This gain is the 
global minimum of the following linear objective minimization problem 
[1, 26, 25): 

Minimize + over X = X? and ¥ such that 


ATX 4+XA XB CT 
BTX —yI pt < 0 
C D —yI 
X > 0 


LQG performance: for a stable LTI system 


G { z= Ax+Bw 
y=Cx 


where w is a white noise disturbance with unit covariance, the LQG or H» 
performance ||G|2 is defined by 


1 TT 
G\If := lim E z/ y" (t)y(t)dt 
NGI = im, tt [Fu 


we [- G4 (jw) G(jw) dw 


li 


It can be shown that 
|G} = inf {Trace (CPC?) : AP + PA? + BBT < 0} 
Hence ||G{|2 is the global minimum of the LMI problem 
Minimize Trace (Q) over the symmetric matrices P,Q such that 
AP+PA™+BB™ < 0 
( per p > % 


Again this is a linear objective minimization problem since the objective 
Trace(Q) is linear in the decision variables (free entries of P,Q). 


1-6 


Further Mathematical Background 


Further Mathematical Background 


Efficient interior-point algorithms are now available to solve the three generic 
LMI problems (1.3)-(1.5) defined on p. 1-4. These algorithms have a 
polynomial-time complexity. That is, the number N(c) of flops needed to 
compute an ¢-accurate solution is bounded by 


N(e) < M N® log(V/e) 


where M is the total row size of the LMI system, N is the total number of 
scalar decision variables, and V is a data-dependent scaling factor. The LMI 
Control Toolbox implements the Projective Algorithm of Nesterov and 
Nemirovski [20, 19]. In addition to its polynomial-time complexity, this 
algorithm does not require an initial feasible point for the linear objective 
minimization problem (1.4) or the generalized eigenvalue minimization 
problem (1.5). 


Some LMI problems are formulated in terms of inequalities rather than strict 
inequalities. For instance, a variant of (1.4) is 


Minimize c’# subject to A(x) <0. 


While this distinction is immaterial in general, it matters when A(x) can be 
made negative semi-definite but not negative definite. A simple example is 


Minimize c’ x subject to ( an >0. (1.6) 
ze 


Such problems cannot be handled directly by interior-point methods which 
require strict feasibility of the LMI constraints. A well-posed reformulation of 


(1.6) would be 


Minimize c? x subject to « >0. 


Keeping this subtlety in mind, we always use strict inequalities in this 
manual. 
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c The LMI Lab 


The LMI Lab is a high-performance package for solving general LMI 
problems. It blends simple tools for the specification and manipulation of 
LMIs with powerful LMI solvers for three generic LMI problems. Thanks to a 
structure-oriented representation of LMIs, the various LMI constraints can be 
described in their natural block-matrix form. Similarly, the optimization 
variables are specified directly as matrix variables with some given structure. 
Once an LMI problem is specified, it can be solved numerically by calling the 
appropriate LMI solver. The three solvers feasp, mincx, and gevp constitute 
the computational engine of the LMI Control Toolbox. Their high performance 
is achieved through C-MEX implementation and by taking advantage of the 
particular structure of each LMI. 


The LMI. Lab offers tools to 


e specify LMI systems either symbolically with the LMI Editor or 
incrementally with the lmivar and lmiterm commands 


e retrieve information about existing systems of LMIs 
e modify existing systems of LMIs 


e solve the three generic LMI problems (feasibility problem, linear objective 
minimization, and generalized eigenvalue minimization) 


e validate results 
This chapter gives a tutorial introduction to the LMI Lab as well as more 


advanced tips for making the most out of its potential. The tutorial material is 
covered by the demo 1midem. 
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Background and Terminology 


Any linear matrix inequality can be expressed in the canonical form 


L(z)=Lo+a¢ili+...+¢¢nLin <0 


where 

e [o,f1,..., Ln are given symmetric matrices 

© c=(2},...,2 nv)" € R* is the vector of scalar variables to be determined. 
We refer to 2;,..., zn as the decision variables. The names “design 


variables” and “optimization variables” are also found in the literature. 


Even though this canonical expression is generic, LMIs rarely arise in this 
form in control applications. Consider for instance the Lyapunov inequality 


ATX +XA<0 (8.1) 


where A = ( Tt 2 ) and the variable X = ( 7% ) is a symmetric 
x2 


Q -—2 £3 
matrix. Here the decision variables are the free entries 21, 22, 23 of X and the 
canonical form of this LMI reads 


—2 2 0 -3 0 0 
0. . 
= ( 9 S)ea( 3  )ta() {ye (8.2) 


Clearly this expression is less intuitive and transparent than (8.1). Moreover, 
the number of matrices involved in (8.2) grows roughly as n?/2 if n is the size 
of the A matrix. Hence, the canonical form is very inefficient from a storage 
viewpoint since it requires storing o(n”/2) matrices of size n when the single 
n-by-n matrix A would be sufficient. Finally, working with the canonical form 
is also detrimental to the efficiency of the LMI solvers. For these various 
reasons, the LMI Lab uses a structured representation of LMIs. For instance, 
the expression A? X + XA in the Lyapunov inequality (8.1) is explicitly 
described as a function of the matrix variable X, and only the A matrix is 
stored. 


In general, LMIs assume a block matrix form where each block is an affine 
combination of the matrix variables. As a fairly typical illustration, consider 
the following LMI drawn from HH, theory 


ATX+XA XCT B 
NT CX —yI D |N<0 (8.3) 
Br DT —-yI 


Background and Terminology 


where A, B,C, D,N are given matrices and the problem variables are 
X = XT € R"“" andy € R. We use the following terminology to describe such 
LMIs: 


e WN is called the outer factor, and the block matrix 


ATX+XA XCT B 
L(X,y) = CX —-yl D 
Br DP —yI 


is called the inner factor. The outer factor needs not be square and is often 
absent. 


e X and y are the matrix variables of the problem. Note that scalars are 
considered as 1 x 1 matrices. 


e The inner factor L(X,7) is a symmetric block matrix, its block structure 
being characterized by the sizes of its diagonal blocks. By symmetry, 
L(X,7) is entirely specified by the blocks on or above the diagonal. 


e Each block of L(X,7) is an affine expression in the matrix variables X and 
7. This expression can be broken down into a sum of elementary terms. For 
instance, the block (1,1) contains two elementary terms: A’ X and XA. 


Terms are either constant or variable. Constant terms are fixed matrices 
like B and D above. Variable terms involve one of the matrix variables, like 
X A, XC? , and —yI above, 


The LMI (8.3) is fully specified by the list of terms in each block, as is any LMI 
regardless of its complexity. 


As for the matrix variables X and 7, they are characterized by their 
dimensions and structure. Common structures include rectangular 
unstructured, symmetric, skew-symmetric, and scalar. More sophisticated 
structures are sometimes encountered in contro! problems. For instance, the 
matrix variable X could be constrained to the block-diagonal structure 
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Summing up, structured LMI problems are specified by declaring the matrix 
variables and describing the term content of each LMI. This term-oriented 
description is systematic and accurately reflects the specific structure of the 
LMI constraints. There is no built-in limitation on the number of LMIs that 
can be specified or on the number of blocks and terms in any given LMI. 
Hence LMI systems of arbitrary complexity can be defined in the LMI Lab. 


Overview of the LMI Lab 


The LMI Lab offers tools to specify, manipulate, and numerically solve LMIs. 
Its main purpose is to 


e allow for straightforward description of LMIs in their natural block-matrix 
form 


¢ provide easy access to the LMI solvers (optimization codes) 
e facilitate result validation and problem modification. 


The structure-oriented description of a given LMI system is stored as a single 
vector called the internal representation and generically denoted by LMtsys in 
the sequel. This vector encodes the structure and dimensions of the LMIs and 
matrix variables, a description of all LMI terms, and the related numerical 
data. It must be stressed that users need not attempt to read or understand 
the content of Luisys since all manipulations involving this internal 
representation can be performed in a transparent manner with LMI-Lab tools. 


The LMI Lab supports the following functionalities: 


Specification of a system of LMIs 

LMI systems can be either specified as symbolic matrix expressions with the 
interactive graphical user interface 1miedit, or assembled incrementally with 
the two commands Imivar and imiterm. The first option is more intuitive and 
transparent while the second option is more powerful and flexible. 


Information retrieval 

The interactive function Imiinfo answers qualitative queries about LMI 
systems created with lmiedit or lmivar and Imiterm. You can also use 
lmiedit to visualize the LMI system produced by a particular sequence of 
lmivar/Imiterm commands. 


Solvers for LMI optimization problems 
General-purpose LMI solvers are provided for the three generic LMI problems 
defined on p. 1-4. These solvers can handle very general LMI systems and 
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matrix variable structures. They return a feasible or optimal vector of decision 
variables x*. The corresponding values X{,..., X}, of the matrix variables are 
given by the function dec2mat. 


Result validation 

The solution «* produced by the LMI solvers is easily validated with the 
functions evalimi and showimi. This allows a fast check and/or analysis of the 
results. With evailmi, all variable terms in the LMI system are evaluated for 
the value «* of the decision variables. The left- and right-hand sides of each 
LMI then become constant matrices that can be displayed with showlmi. 


Modification of a system of LMIs 
An existing system of LMIs can be modified in two ways: 


e An LMI can be removed from the system with delimi. 


« Amatrix variable X can be deleted using delmvar. It can also be 
instantiated, that is, set to some given matrix value. This operation is 
performed by setmvar and allows, for example, to fix some variables and 
solve the LMI problem with respect to the remaining ones. 


cifying a System of LMIs 


The LMI Lab can handle any system of LMIs of the form 
NT £(X,...,XK) N < M?™ R(X,...,XK) M 
where 


e X,,...,X« are matrix variables with some prescribed structure 


e the left and right outer factors V and M are given matrices with identical 
dimensions 


e the left and right inner factors C(.) and R(-) are symmetric block matrices 
with identical block structures, each block being an affine combination of 
X1,...,X« and their transposes. 
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IMPORTANT: Throughout this chapter, “left-hand side” refers 
to what is on the “smaller” side of the inequality, and “right- 
hand side” to what is on the “larger” side. Accordingly, X is 
called the right-hand side and 0 the left-hand side of the LMI 


0O< X 
even when this LMI is written as 


X>0. 


The specification of an LMI system involves two steps: 


1. Declare the dimensions and structure of each matrix variable X;,..., Xx. 
2. Describe the term content of each LMI. 


This process creates the so-called internal representation of the LMI system. 
This computer description of the problem is used by the LMI solvers and in all 
subsequent manipulations of the LMI system. It is stored as a single vector 
which we consistently denote by LMIsys in the sequel (for the sake of clarity). 


There are two ways of generating the internal description of a given LMI 
system: (1) by a sequence of lmivar/1miterm commands that build it 
incrementally, or (2) via the LMI Editor 1miedit where LMIs can be specified 
directly as symbolic matrix expressions. Though somewhat less flexible and 
powerful than the command-based description, the LMI Editor is more 
straightforward to use, hence particularly well-suited for beginners. Thanks 
to its coding and decoding capabilities, it also constitutes a good tutorial 
introduction to lmivar and lmiterm. Accordingly, beginners may elect to skip 
the subsections on lmivar and lmiterm and to concentrate on the GUI-based 
specification of LMIs with lmiedit. 


A Simple Example 

The following tutorial example is used to illustrate the specification of LMI 
systems with the LMI-Lab tools. Run the demo 1midem to see a complete 
treatment of this example. 


Example 8.1: Consider a stable transfer function 


G(s) = C(sI — A)7'B (8.4) 


Specifying a System of LMIs 


with 4 inputs, 4 outputs, and 6 states, and consider the set of input/output 
scaling matrices D with block-diagonal structure 


d} 0 0 0 
_[0 d& 0 0 

D=14 0 & del: (8.5) 
0 0 dy ds 


The following problem arises in the robust stability analysis of systems with 
time-varying uncertainty [4]: 


Find, if any, a scaling D of structure (8.5) such that the largest gain across 
frequency of D G(s) D~' is less than one. 


This problem has a simple LMI formulation: there exists an adequate scaling 
D iff. the following feasibility problem has solutions: 


Find two symmetric matrices X € R°*® and $= D™D € R**4 such that 


T T 
( X4 XAG SC xB 0 (86) 
xX > 0 (8.7) 
S > TI. (8.8) 


The LMI system (8.6)-(8.8) can be described with the LMI Editor as outlined 
on p. 8-13 below. Alternatively, its internal description can be generated with 
Imivar and lmiterm commands as follows: 


setlmis([]) 
X=lmivar(1,[6 1]) 
S=lmivar(1,[{2 0;2 1]) 


% ist LMI 

Imiterm([1 1 1 x],1,A,'s') 
Imiterm([1 1 1 $],c',C) 
Imiterm([1 1 2 X},1,B) 
Imiterm([1 2 2 8},-1,1) 


% 2nd LMI 
Imiterm([{-2 1 1 X},1,1) 


% 3rd LMI 
lImiterm([-3 1 1 S],1,1) 
Imiterm(([3 1 1 0]),1) 


LMISYS' = getlmis 
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Here the Imivar commands define the two matrix variables X and S while the 
lmitexm commands describe the various terms in each LMI. Upon completion, 
getlmis returns the internal representation Lursys of this LMI system. The 
next three subsections give more details on the syntax and usage of these 
various commands. More information on how the internal representation is 
updated by lmivar/1miterm can also be found on p. 8-15. 


setimis and getimis 


The description of an LMI system should begin with set1mis and end with 


getlmis. The function set 1mis initializes the LMI system description. When 
specifying a new system, type 


setlmis([]) 


To add on to an existing LMI system with internal representation LM1s0, type 


setlmis(LMISO0) 


When the LMI system is completely specified, type 


LMISYS = getlmis 


This returns the internal representation Lm1sys of this LMI system. 
ThisMATLAB description of the problem can be forwarded to other LMI-Lab 
functions for subsequent processing. The command get1mis must be used only 
once and after declaring all matrix variables and LMI terms. 


Imivar 


The matrix variables are declared one at a time with Imivar and are 
characterized by their structure. To facilitate the specification of this 


structure, the LMI Lab offers two predefined structure types along with the 
means to describe more general structures: 
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Type 1: Symmetric block diagonal structure. This corresponds to matrix 
variables of the form 


D, 0 0 

x= 0 Ds 
0 
0 0 OD, 


where each diagonal block D; is square and is either zero, a full 
symmetric matrix, or a scalar matrix 


Dj=dxI, deR. 


This type encompasses ordinary symmetric matrices (single block) 
and scalar variables (one block of size one). 


Type 2: Rectangular structure. This corresponds to arbitrary rectangular 
matrices without any particular structure. 


Type 3: General structures. This third type is used to describe more 
sophisticated structures and/or correlations between the matrix 
variables. The principle is as follows: each entry of X is specified 
independently as either 0, x,, or -x, where z,, denotes the n-th 
decision variable in the problem. For details on how to use Type 3, 
see pp. 8-25 through 8-28 below as well as the lmivar entry of the 
Command Reference chapter. 


In Example 8.1, the matrix variables X and S are of Type 1. Indeed, both are 


symmetric and S inherits the block-diagonal structure (8.5) of D. Specifically, 
S is of the form - 


ss 0 0 O 
0 $1 0 0 
c= 0 0 82 $3 
0 0 8&3 84 
After initializing the description with the command setimis([]), these two 


matrix variables are declared by 


lmivar(1,[6 1)) xX 
lmivar(1, {2 0;2 1)) %S 


In both commands, the first input specifies the structure type and the second 
input contains additional information about the structure of the variable: 
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¢ for a matrix variable X of Type 1, this second input is a matrix with two 
columns and as many rows as diagonal blocks in X. The first column lists 


the sizes of the diagonal blocks and the second column specifies their 
nature with the following convention: 


1 —+ full symmetric block 
0 —- _ sealar block 
-l1 —. zero block 


In the second command, for instance, [2 0;2 1] means that S has two 


diagonal blocks, the first one being a 2 x 2 scalar block and the second one a 
2 x 2 full block. 


e for matrix variables of Type 2, the second input of Imivar is a two-entry 
vector listing the row and column dimensions of the variable. For instance, 
a3 x 5 rectangular matrix variable would be defined by 

Imivar (2,13 5]) 


For convenience, lmivar also returns a “tag” that identifies the matrix 


variable for subsequent reference. For instance, X and S in Example 8.1 could 
be defined by 


».¢ 
Ss 


Imivar(1,[6 1]) 
Imivar(1,[2 0;2 1]) 


oH 


The identifiers x and s are integers corresponding to the ranking of X and $ 
in the list of matrix variables (in the order of declaration). Here their values 
would be x=1 and s=2. Note that these identifiers still point to X and S after 
deletion or instantiation of some of the matrix variables. Finally, Imivar can 
also return the total number of decision variables allocated so far as well as 

the entry-wise dependence of the matrix variable on these decision variables 


(see p. 8-25 and the lmivar entry of the Command Reference chapter for more 
details). 


Imiterm 


After declaring the matrix variables with 1mivar, we are left with specifying 
the term content of each LMI. Recall that LMI terms fall into three categories: 


e the constant terms, i.e., fixed matrices like I in the left-hand side of the 
LMI S>I 


e the variable terms, i.e., terms involving a matrix variable. For instance, 
ATX and C7’ SC in (8.6). Variable terms are of the form PXQ where X is a 
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variable and P,Q are given matrices called the left and right coefficients, 
respectively 


e the outer factors. 


The following rule should be kept in mind when describing the term content of | 
an LMI: 


IMPORTANT: specify.only the terms in the blocks on or above 
the diagonal. The inner factors being symmetric, this is suffi- 
cient to specify the entire LMI. Specifying all blocks results in 
the duplication of off-diagonal terms, hence in the creation of a 
different LMI, Alternatively, users may describe the blocks on 
or below the diagonal. 


LMI terms are specified one at a time with Imiterm. For instance, the LMI 


ATX+XA+CTSC XB <0 
BTX —S 
is described by 


Imiterm({1 1 1 1],1,A,'s') 
Imiterm([1 1 1 2],c',c) 
Imiterm([1 1 2 1],1,B) 
lmiterm([1 2 2 2],-1,1) 


These commands successively declare the terms A’ X + XA, C'’SC, XB, 
and —.S. In each command, the first argument is a four-entry vector listing the 
term characteristics as follows: 


e the first entry indicates to which LMI the term belongs. The value m means 
“left-hand side of the m-th LMI,” and -m means “right-hand side of the m-th 
LMI” 


e the second and third entries identify the block to which the term belongs. 
For instance, the vector {1 1 2 1] indicates that the term is attached to 
the (1, 2) block 


e the last entry indicates which matrix variable is involved in the term. This 
entry is 0 for constant terms, k for terms involving the k-th matrix variable 
X;, and -k for terms involving X P (here X and S are first and second 
variables in the order of declaration). 


Finally, the second and third arguments of Imiterm contain the numerical 
data (values of the constant term, outer factor, or matrix coefficients P and Q 
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for variable terms PXQ or PX7Q). These arguments must refer to existing 
MATLAB variables and be real-valued. See p. 8-28 for the specification of LMIs 
with complex-valued coefficients. 


Some shorthand is provided to simplify term specification. First, blocks are 
zero by default. Secondly, in diagonal blocks the extra argument 's' allows 
you to specify the conjugated expression AX B + B? X7 A? with a single 
lmiterm command. For instance, the first command specifies A7X + XA as 
the “symmetrization” of XA. Finally, scalar values are allowed as shorthand 
for scalar matrices, i.e., matrices of the form aJ with a scalar. Thus, a 
constant term of the form «J can be specified as the “scalar” a. This also 
applies to the coefficients P and Q of variable terms. The dimensions of scalar 
matrices are inferred from the context and set to 1 by default. For instance, 
the third LMI S > TJ in Example 8.1 is described by 


lmiterm([-3 1 1 2],1,1) % 1*s*1 = 5S 

lmiterm({3 1 1 01,1) % 1i*Il =I 

Recall that by convention S is considered as the right-hand side of the 
inequality, which justifies the —3 in the first command. 


Finally, to improve readability it is often convenient to attach an identifier 
(tag) to each LMI and matrix variable. The variable identifiers are returned 
by lmivar and the LMI identifiers are set by the function newlmi. These 
identifiers can be used in Imiterm commands to refer to a given LMI or matrix 
variable. For the LMI system of Example 8.1, this would look like: 


setimis({]) 
Xx lmivar({1,[6 1]) 
s imivar(1,[2 0;2 1)) 


BRL = newlmi 


lmiterm([BRL 1 1 X],1,A,'s!) 
Imiterm((BRL 1 1 $],C',C) 
lmiterm([BRL 1 2 X],1,B) 
Imiterm([{BRL 2 2 S],-1,1) 


Xpos = newlmi 
lmiterm([{-Xpos 1 1 X},1,1) 


Slmi = newlmi 
lmiterm({-Slmi 1 1 Sj,1,1) 
lmiterm({Slmi 1 1 0],1) 


LMISYS = getlmis 
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Here the identifiers x and s point to the variables X and S while the tags BRL, 
Xpos, and Simi point to the first, second, and third LMI, respectively. Note 
that -xpos refers to the right-hand side of the second LMI. Similarly, -x would 
indicate transposition of the variable X. 


The LMI Editor Imiedit 


The LMI Editor 1miedit is a graphical user interface (GUI) to specify LMI 
systems in a straightforward symbolic manner. Typing 
lmiedit 


calls up a window with several editable text areas and various pushbuttons. 
To specify your LMI system, 


1. Declare each matrix variable (name and structure) in the upper half of the 
worksheet. The structure is characterized by its type (s for symmetric block 
diagonal, R for unstructured, and c for other structures) and by an 
additional “structure” matrix. This matrix contains specific information 


about the structure and corresponds to the second argument of Imivar (see 
p. 8-8 for details). 


Please use one line per matrix variable in the text editing areas 


2. Specify the LMIs as MATLAB expressions in the lower half of the 
worksheet. For instance, the LMI 


T 
ATX+XA XB <0 
BTX I 


is entered by typing 
[a'*x+x*a x*b ; b!*x -1) < 0 


if x is the name given to the matrix variable X in the upper half of the 


worksheet. The left- and right-hand sides of the LMIs should be valid 
MATLAB expressions. 


Once the LMI system is fully specified, the following tasks can be performed 
by pressing the corresponding button: 


e Visualize the sequence of imivar/1miterm commands needed to describe 
this LMI system (view commands buttons). Conversely, the LMI system 
defined by a particular sequence of lmivar/lmiterm commands can be 
displayed as a MATLAB expression by clicking on the describe... buttons. 
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Beginners can use this facility as a tutorial introduction to the lmivar ang 
imiterm commands. 


e Save the symbolic description of the LMI system as a MATLAB string (save 


button). This description can be reloaded later on by pressing the load 
button. 


e Read a sequence of lmivar/lmiterm commands from a file (read button). 
You can then click on “describe the matrix variables” or “describe 
the LMis...” to visualize the symbolic expression of the LMI system 
specified by these commands. The file should describe a single LMI system 
but may otherwise contain any sequence of MATLAB commands. 


This feature is useful for code validation and debugging. 

e Write in a file the sequence of lmivar/Imiterm commands needed to 
describe a particular LMI system (write button). 
This is helpful to develop code and prototype MATLAB functions based on 
the LMI Lab. 


e Generate the internal representation of the LMI system by pressing 
create. The result is written in a MATLAB variable named after the LMI 
system (if the “name of the LMI system” is set to my1mi, the internal 
representation is written in the MATLAB variable my1mi). Note that all 
LMI-related data should be defined in the MATLAB workspace at this stage. 


The internal representation can be passed directly to the LMI solvers or 
any other LMI Lab function. 


As with lmiterm, you can use various shortcuts when entering LMI 
expressions at the keyboard. For instance, zero blocks can be entered simply 
as 0 and need not be dimensioned. Similarly, the identity matrix can be 
entered as 1 without dimensioning. Finally, upper diagonal LMI blocks need 
not be fully specified. Rather, you can just type (*) in place of each such block. 


Though fairly general, 1miedit is not as flexible as Imiterm and the following 
limitations should be kept in mind: 


¢ parentheses cannot be used around matrix variables. For instance, the 
expression 
(a*x+b) '*o +4 c!*(atx+b) 
is invalid when x is a variable name. By contrast, 
(a+b) '*x + x'* (a+b) 


is perfectly valid 
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e loops and if statements are ignored 


e when turning Imiterm commands into a symbolic description of the LMI 
system, an error is issued if the first argument of Imiterm cannot be 
evaluated. Use the LMI and variable identifiers supplied by newlmi and 
imivar to avoid such difficulties. 


Figure 8-1 shows how to specify the feasibility problem of Example 8.1 on p. 
8-6 with lmiedit. 


How It All Works 


Users familiar with MATLAB may wonder how lmivar and lmiterm physically 
update the internal representation LMISYS since LMTSYs is not an argument to 
these functions. In fact, all updating is performed through global variables for 
maximum speed. These global variables are initialized by set mis, cleared by 
getlmis, and not visible in the workspace. Even though this artifact is 
transparent from the user’s viewpoint, be sure to 


e invoke get1mis only once and after completely specifying the LMI system 


e refrain from using the command clear global before the LMI system 
description is ended with get 1mis. 
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JATX + A+ CS*C XB; BPX 8] <0 


X>0 


S>1 


Figure 8-1: Graphical user interface Imiedit. 
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trieving Information 


Recall that the full description of an LMI system is stored as a single vector 
called the internal representation. The user should not attempt to read or 
retrieve information directly from this vector. Three functions called Imiintfo, 
iminbr, and matnbr are provided to extract and display all relevant 
information in a user-readable format. 


Imiinfo 


lmiinfo is an interactive facility to retrieve qualitative information about 
LMI systems. This includes the number of LMIs, the number of matrix 
variables and their structure, the term content of each LMI block, etc. To 
invoke imiinfo, enter 


lmiinfo(LMISYS) 


where LMISys is the internal representation of the LMI system produced by 
get imis, 


Iminbr and matnbr 

These two functions return the number of LMIs and the number of matrix 
variables in the system. To get the number of matrix variables, for instance, 
enter 


matnbr (LMISYS) 


I Solvers 


LMI solvers are provided for the following three generic optimization 
problems (here x denotes the vector of decision variables, i.e., of the free 
entries of the matrix variables X;,..., Xx): 


e feasibility problem: 


Find « € R” (or equivalently matrices X;,..., Xx with prescribed 
structure) that satisfies the LMI system 


A(e) < Ble). 


The corresponding solver is called feasp. 
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e minimization of a linear objective under LMI constraints: 


Minimize cx over c € R% subject to A(z) < Biz). 


The corresponding solver is called mincx. 


e generalized eigenvalue minimization problem: 


Minimize 2 over « € R subject to 


Ciz) < D(z) 
0 < Bix) 
A(z) < AB(2). 


The corresponding solver is called gevp. 


Note that A(x) < B(x) above is a shorthand notation for general structured 
LMI systems with decision variables x = (11,...,zn). 


The three LMI solvers feasp, mincx, and gevp take as input the internal 
representation LMisys of an LMI system and return a feasible or optimizing 
value «* of the decision variables. The corresponding values of the matrix 
variables X,,..., Xx are derived from x* with the function dec2mat. These 
solvers are C-MEX implementations of the polynomial-time Projective 
Algorithm of Nesterov and Nemirovski [8, 2]. 


For generalized eigenvalue minimization problems, it is necessary to 
distinguish between the standard LMI constraints C(«) < D(x) and the 
linear-fractional LMIs 

A(z) < A B(x) 


attached to the minimization of the generalized eigenvalue 4. When using 
gevp, three rules should be followed to ensure proper specification of the 
problem: 


e specify the LMIs involving A as A(z) < B(x) (without the 4}) 
e specify them last in the LMI system. gevp systematically assumes that the 
last L LMIs are linear-fractional if 1 is the number of LMIs involving 4 


e add the constraint 0 < B(x) or any other constraint that enforces it. This 
positivity constraint is required for well-posedness of the problem and is 


not automatically added by gevp (see the Command Reference chapter for 
details). 
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An initial guess xinit for z can be supplied to mincx or gevp. Use mat2dec to 
derive xinit from given values of the matrix variables X),..., Xx. Finally, 
various options are available to control the optimization process and the 
solver behavior. These options are described in detail in the Command 
Reference chapter. 


The following example illustrates the usage of the mincx solver. 


Example 8.2: Consider the optimization problem 


Minimize Trace(X) subjectto ATX +XA+XBBTX+Q<0 (8.9) 


with data 
-l1 ~2 1 1 1 -1 ‘0 
A= 3 2 1}; B=] 0]; Q@=] -1 -3 —12 
1 -2 -1 1 0 —12 —36 


it can be shown that the minimizer X* is simply the stabilizing solution of the 
algebraic Riccati equation 


ATX +XA+XBB™X+Q=0. 


This solution can be computed directly with the Riccati solver care and 
compared to the minimizer returned by mincx. 


From an LMI optimization standpoint, problem (8.9) is equivalent to the 
following linear objective minimization problem: 


ATX +XA+Q XB 


Minimize Trace(X) subject to ( BI _] 


) <0. (8.10) 


’ Since Trace(X) is a linear function of the entries of X, this problem falls 
within the scope of the mincx solver and can be numerically solved as follows: 


1. Define the LMI constraint (8.9) by the sequence of commands 


setlmis([]) 
X = lmivar(1,[3 1)) % variable xX, full symmetric 


imiterm({1 1 1 
lmiterm([1 11 
imiterm([(1 2 2 0],-1) 
lmiterm({1 2 1 


X],1,a,'s') 


LMIs = getlmis 
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2. Write the objective Trace(X) as c’ x where z is the vector of free entries of 
X. Since c should select the diagonal entries of X, it is obtained as the 
decision vector corresponding to X = J, that is, 


c = mat2dec(LMIs, eye(3)) 


Note that the function defcx provides a more systematic way of specifying 
such objectives (see p. 8-30 for details). 


3. Call mincx to compute the minimizer xopt and the global minimum copt = 
c’*xopt of the objective: 


options = [le-5,0,0,0,0] 
[copt,xopt] = mincx(LMIs,c,options) 


Here 1e-5 specifies the desired relative accuracy on copt. 


The following trace of the iterative optimization performed by mincx 
appears on the screen: 


Solver for linear objective minimization under LMI constraints 


Tterations “t Best objective value so far 
1 

2 ~8.511476 
3 -13.063640 

KK new lower bound: -34.023978 
4 -15.768450 

Laid new lower bound: ~25.005604 
5 ~17.123012 

ake new lower bound: ~21.306781 
6 ~17. 882558 

RK new lower bound: ~19.819471 
7 -18.339853 

ake new lower bound: -19.189417 
8 -18.552558 

RK new lower bound: ~18.919668 
9 ~18.646811 

eK new lower bound: -18.803708 
10 -18.687324 

aie new lower bound: ~18.753903 
Vi -18.705715 

xk new lower bound: -18.732574 
12 -~18.712175 

wae new lower bound: ~18.723491 
13 -18.714880 

iallal new lower bound: ~18.719624 
14 ~18.716094 

ake new lower bound: -18.717986 
15 -18.716509 
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aK new lower bound: -18.717297 
16 -18.716695 
cial new lower bound: ~18.716873 
Result: feasible solution of required accuracy 
best objective value: -~18.716695 
guaranteed relative accuracy: 9.50e-06 
f-~radius saturation: 0.000% of R= 1.00e+09 


The iteration number and the best value of c’ x at the current iteration 
appear in the left and right columns, respectively. Note that no value is 
displayed at the first iteration, which means that a feasible x satisfying the 
constraint (8.10) was found only at the second iteration. Lower bounds on 
the global minimum of c’ x are sometimes detected as the optimization 
progresses. These lower bounds are reported by the message 


KKK new lower bound: XXX 


Upon termination, mincx reports that the global minimum for the objective 
Trace(X) is —18.716695 with relative accuracy of at least 9.5 x 107°. This is 
the value copt returned by mincx. 


4. mincx also returns the optimizing vector of decision variables xopt. The 
corresponding optimal value of the matrix variable X is given by 


Xopt = dec2mat (LMIs,xopt,X) 


which returns 


—6.3542 —5.8895 2.2046 
Xopt = | —5.8895 —-6.2855 2.2201 
2.2046 2.2201 —6.0771 
This result can be compared with the stabilizing Riccati solution computed 
by care: 
Xst = care(a,b,q,-1) 
norm (Xopt -Xst) 


ans = 
6.5390e-05 
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From Decision to Matrix Variables and Vice-Versa 


While LMIs are specified in terms of their matrix variables X;,...,.Xx, the 
LMI solvers optimize the vector z of free scalar entries of these matrices, 
called the decision variables. The two functions mat2dec and dec2mat perform 
the conversion between these two descriptions of the problem variables. 


Consider an LMI system with three matrix variables X,, X2, X3. Given 
particular values x1, x2, x3 of these variables, the corresponding value xdec of 
the vector of decision variables is returned by mat2dec: 


xdec = mat2dec(LMISYS,X1,X2,X3) 


An error is issued if the number of arguments following Lutsvs differs from 
the number of matrix variables in the problem (see matnbr). 


Conversely, given a value xdec of the vector of decision variables, the 
corresponding value of the k-th matrix is given by dec2mat. For instance, the 
value x2 of the second matrix variable is extracted from xdec by 


X2 = dec2mat (LMISYS,xdec,2) 


The last argument indicates that the second matrix variable is requested. It 
could be set to the matrix variable identifier returned by imivar. 


The total numbers of matrix variables and decision variables are returned by 
matnbr and decnbr, respectively. In addition, the function decinfo provides 
precise information about the mapping between decision variables and matrix 
variable entries (see the Command Reference chapter). 
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The LMI Lab offers two functions to analyze and validate the results of an 
LMI optimization. The function evallmi evaluates all variable terms in an 
LMI system for a given value of the vector of decision variables, for instance, 
the feasible or optimal vector returned by the LMI solvers. Once this 
evaluation is performed, the left- and right-hand sides of a particular LMI are 
returned by showlmi. 


In the LMI problem considered in Example 8.2 on p. 8-19, you can verify that 
the minimizer xopt returned by mincx satisfies the LMI constraint (8.10) as 
follows: 
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evimi = evallmi (LMIs,xopt) 
{lhs,rhs] = showlmi(evlmi,1) 


The first command evaluates the system for the value xopt of the decision 
variables, and the second command returns the left- and right-hand sides of 
the first (and only) LMI. The negative definiteness of this LMI is checked by 


eig(lhs-rhs) 


ans = 
-2.0387e-04 
~3.9333e-05 
~1.8917e-07 
~4.6680e+01 


odifying a System of LMIs 


Once specified, a system of LMIs can be modified in several ways with the 
functions delimi, delmvar, and setmvar. 


dellmi 


The first possibility is to remove an entire LMI from the system with dellmi. 
For instance, suppose that the LMI system of Example 8.1 on p. 8-6 is 


described in tmisys and that we want to remove the positivity constraint on 
X. This is done by 


NEWSYS = dellmi(LMISYS,2) 


where the second argument specifies deletion of the 2nd LMI. The resulting 
system of two LMiIs is returned in NEWSsys. 


The LMI identifiers (initial ranking of the LMI in the LMI system) are not 
altered by deletions. As a result, the last LMI 


S>TI 


remains known as the third LMI even though it now ranks second in the 
modified system. To avoid confusion, it is safer to refer to LMIs via the 
identifiers returned by newlmi. If BRL, Xpos, and Slmi are the identifiers 
attached to the three LMIs (8.6)-(8.8), Slmi keeps pointing to S > J even after 
deleting the second LMI by 


NEWSYS = dellmi(LMISYS, Xpos) 
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delmvar 

Another way of modifying an LMI system is to delete a matrix variable, that 
is, to remove all variable terms involving this matrix variable. This operation 
is performed by delmvar. For instance, consider the LMI 


ATX 4XA4BW+W'BT+I<0 


with variables X = XT € R**4 and W € R24, This LMI is defined by 


setlimis({]) 
X = lmivar(1,[(4 1]) & xX 
W = lmivar(2,[2 4]) %W 


lmiterm({1 1 1 X],1,A,'s' 
Imiterm([1 1 1 W],B,1,'s' 
Imiterm([{[1 1 1 0],1) 


LMISYS = getimis 


To delete the variable W, type the command 


NEWSYS = delmvar (LMISYS,W) 
The resulting NEwsys now describes the Lyapunov inequality 
ATX +XA4+1<0. 


Note that delmvar automatically removes all LMIs that depended only on the 
deleted matrix variable. 


The matrix variable identifiers are not affected by deletions and continue to 
point to the same matrix variable. For subsequent manipulations, it is 
therefore advisable to refer to the remaining variables through their 
identifier. Finally, note that deleting a matrix variable is equivalent to setting 
it to the zero matrix of the same dimensions with setmvar. 


setmvar 


The function setmvar is used to set a matrix variable to some given value. As 
a result, this variable is removed from the problem and all terms involving it 
become constant terms. This is useful, for instance, to fix some variables and 
optimize with respect to the remaining ones. 


Advanced Topics 


Consider again Example 8.1 on p. 8-6 and suppose we want to know if the 
peak gain of G itself is less than one, that is, if 


Glo <1. 


This amounts to setting the scaling matrix D (or equivalently, S = DT D) to a 
multiple of the identity matrix. Keeping in mind the constraint S >TI,a 
legitimate choice is S = 2 x I. To set S to this value, enter 


NEWSYS = setmvar(LMISYS,S, 2) 


The second argument is the variable identifier s, and the third argument is 
the value to which S should be set. Here the value 2 is shorthand for 2 x I. 
The resulting system NEwsys reads 


[ee narncte XB 


BTX ~2 9 
X > 0 
2flo > ZI, 


Note that the last LMI is now free of variable and trivially satisfied. Hence it 
could be deleted altogether by 


NEWSYS = dellmi (NEWSYS,3) 
or 
NEWSYS = dellmi (NEWSYS,S1mi) 


if Slmi is the identifier returned by newlmi. 


anced Topics 


This last section gives a few hints for making the most out of the LMI Lab. It 
is directed toward users who are comfortable with the basics described above. 


Structured Matrix Variables 


Fairly complex matrix variable structures and interdependencies can be 
specified with lmivar. Recall that the symmetric block-diagonal or 
rectangular structures are covered by Types 1 and 2 of Imivar provided that 
the matrix variables are independent. To describe more complex structures or 
correlations between variables, you must use Type 3 and specify each entry of 
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